Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update rule grouping section #211

Closed
wants to merge 1 commit into from
Closed

Update rule grouping section #211

wants to merge 1 commit into from

Conversation

kasperisager
Copy link

@kasperisager kasperisager commented May 9, 2018

@kasperisager
Copy link
Author

Should we add act-rules-format.html to .gitignore by the way?

@@ -66,7 +66,9 @@ Accessibility Requirements {#structure-accessibility-requirements}

An ACT Rule MUST identify the accessibility requirements to which the rule maps. For example, WCAG 2.0 Success Criterion 1.1.1. An ACT Rule is a complete or partial test for one or more accessibility requirements.

Outcomes from an ACT Rule MUST be consistent with the accessibility requirement, e.g. a rule only returns the outcome Fail when the content fails the accessibility requirement. This means that the rule maps to the accessibility requirement, as opposed to it merely being related to the requirement, thematically or otherwise.
Outcomes from an ACT Rule that is not part of an [aggregation group](#grouping) MUST be consistent with the accessibility requirement, e.g. a rule only returns the outcome Fail when the content fails the accessibility requirement. This means that the rule maps to the accessibility requirement, as opposed to it merely being related to the requirement, thematically or otherwise.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"rule only returns the outcome Fail when the content fails the accessibility requirement" That's not correct. Rules can return fail, even if the requirement is passed. If only one rule in a group has to pass for the AR to pass, than any number of rules can fail without the AR failing.

Copy link

@annethyme annethyme May 24, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@WilcoFiers, This section is about "ACT Rule that is not part of an aggregation group". Next section is about "ACT Rules that are part of aggregation groups".

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"e.g. a rule only returns the outcome Fail when the content fails the accessibility requirement." --> "e.g. a rule not in a group only returns the outcome Fail when the content fails the accessibility requirement."

Outcomes from an ACT Rule MUST be consistent with the accessibility requirement, e.g. a rule only returns the outcome Fail when the content fails the accessibility requirement. This means that the rule maps to the accessibility requirement, as opposed to it merely being related to the requirement, thematically or otherwise.
Outcomes from an ACT Rule that is not part of an [aggregation group](#grouping) MUST be consistent with the accessibility requirement, e.g. a rule only returns the outcome Fail when the content fails the accessibility requirement. This means that the rule maps to the accessibility requirement, as opposed to it merely being related to the requirement, thematically or otherwise.

For ACT Rules that are part of aggregation groups, the aggregated outcome of the aggregation group MUST be consistent with the accessibility requirement. For this to be possible, ACT Rules in an aggregation group MUST share at least one common accessibility requirement.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems to be repeating what is in the previous paragraph. I don't think this should say "aggregated outcome". It's just "the outcome of the aggregation group" is sufficient.

Question: Should the aggregation groups themselves be associated with accessibility requirements, rather than the rules within them?

In accessibility testing, there are often multiple ways to solve the same problem. For instance, header cells in HTML tables can be indicated through the `scope` attribute, by using the `headers` attribute, or by using ARIA labels. All of these separate techniques could be described in one big rule. But this creates a large, and often difficult to maintain rule. To ensure rules are kept small and atomic, they SHOULD be put into a rule-group instead.
In accessibility testing, there are often different ways to make the same type of content accessible. These different techniques could be described in one big rule. This however creates large, and often difficult to maintain rules.

Rules are kept small and atomic. If there are multiple ways of passing the same accessibility requirement for the same content, these SHOULD be written as separate rules and be put into an aggregation group instead. A rule MAY be part of multiple aggregation groups.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rules should be kept small and atomic.

<li>Header indicated by using the `headers` attribute</li>
<li>Header indicated by using ARIA labels</li>
</ul>
<p>Aggregation logic for group: for a given test target to pass the group, any of the rules within the group must output a passed result for the test target.</p>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest "at leats one" instead of "any".

@WilcoFiers
Copy link
Collaborator

Closing this PR, as it is superseded by #217.

@WilcoFiers WilcoFiers closed this Jun 18, 2018
@kasperisager kasperisager deleted the aggregation-groups branch June 18, 2018 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants